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1. Field of the Invention 

The present invention relates broadly to the field of 
telecommunications. More particularly, the present invention 
relates to the management of shared memory buffers in an 
asynchronous transfer mode (ATM) switch or node by setting of 
queue size and dynamic queue thresholds as functions of overall 
buffer occupancy and service category. 

2. state of the Art 

Perhaps the most awaited, and now fastest growing 
technology in the field of telecommunications in the 1990's is 
known as Asynchronous Transfer Mode (ATM) technology. ATM is 
providing a mechanism for removing performance limitations of 
local area networks (LANs) and wide area networks (WANs) and 
providing data transfers at a speed of on the order of 
gigabits/second. The variable length packets of LAN and WAN 
data are being replaced with ATM cells which are relatively 
short, fixed length packets. Because ATM cells can carry voice, 
video and data across a single backbone network, the ATM 
technology provides a unitary mechanism for high speed end-to- 
end telecommunications traffic. 

Because the data contained in the ATM cells can be 
generated from either generally fixed rate communications, or 
bursty type communications, it will be appreciated that traffic 
accommodation mechanisms have been introduced in order to avoid 
situations where ATM switches or nodes are over-taxed, resulting 
in loss of cells. In particular, various buffering mechanisms 
are well known. Among these include input queues, output 
queues, and shared buffers. It is now generally agreed that 
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shared buffers are the preferred mechanism for implementing 
either input queues or output queues (or both) in an ATM switch. 

The simplest implementation of shared memory buffers sets 
up queues for virtual connections (VCs) as needed and sets a 
queue length threshold for each queue regardless of the service 
category of the VC. This implementation is often referred to as 
the "Static Threshold" scheme. Arriving cells are admitted to 
the queue only if the queue length is smaller than the threshold 
set for the queue. Although the Static Threshold scheme is 
simple to implement, it does not adapt to changing traffic 
conditions. If one port in the switch (one VC) is very active, 
cells from that VC will be lost even if there is shared memory 
available to enlarge the queue. 

Several "Dynamic Threshold" schemes have been proposed. 
These schemes attempt to adjust the queue length thresholds of 
all of the queues in shared memory based on the amount of 
currently available memory. One scheme for dynamic buffer 
management is disclosed in A. K. Choudhury and E. L. Hahne, 
Dynamic Queue Length Thre sholds in a Shared Memory ATM Switch . 
Proc. IEEE INFOCOM '96 (San Francisco, California) pp. 1-9, 
March 1996 (hereinafter "Choudhury") . According to Choudhury, a 
control threshold T(t) at time t is set (using notation of the 
present invention) equal to a multiple y of the unused buffer 
space as shown in equation (1) where B is the total size of the 
shared buffer and U is the size of the used portion of the 
buffer. 

T(t)=r'(B-U) (1) 

If any queue reaches a length greacer than or equal to the 
control threshold Tft;, cells destined for that queue will be 
discarded. Choudhury states that y should be a positive, 
negative, or zero power of two so that a shifter can be used to 
regulate the control threshold. According to Choudhury, y is 
adjusted depending on whether the switch is moderately loaded or 
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heavily loaded and whether the load is uniform across all ports 
or non-uniform with one port more heavily loaded than others • 

The Dynamic Threshold scheme of Choudhury is essentially a 
Static Threshold Scheme which is dynamically tuned according to 
load conditions in the switch • All VCs are treated equally and 
a certain amount of buffer space is intentionally wasted to 
accomplish this* The Choudhury scheme excels when there is a 
uniform load on the switch but does not provide much improvement 
over Static Threshold schemes when only a few ports in the 
switch are overloaded. Also, as specifically noted by 
Choudhury, the scheme does not address the issue of multiple 
service categories. 

Current ATM service is offered in different categories 
according to a user's needs. Some of these categories include 
constant bit rate (CBR) , variable bit rate (VBR) , unspecified 
bit rate (UBR) , and available bit rate (ABR) . Some categories 
are given a higher priority than others when decisions are made 
to discard cells. For example, it is desirable that cells 
rarely, if ever, be discarded from CBR traffic. It has been 
recognized that the category of service should be taken into 
account when managing queues in shared memory. However, no 
scheme has been proposed for doing so. 

SUMMARY OF THE INVENTION 

It is therefore an object of the invention zo provide a 
dynamic buffer management scheme for ATM switches. 

It is also an object of the invention to provide a dynamic 
buffer management scheme which allocates shared buffer memory to 
VC queues based in part on the service category of the VC. 

It is another object of the invention to provide a dynamic 
buffer management scheme which adjusts the allocation of shared 
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buffer memory to VC queues based in part on the service category 
of the VC and overall congestion in the ATM switch. 

In accord with these objects which will be discussed in 
detail below, the buffer management scheme of the present 
invention sets different dynamic thresholds for different VCs 
according to the formula expressed in equation (2) , 

As in equation (1), B is the total size of the shared buffer and 
U is the size of the used portion of the buffer. According to 
the invention, Ti(U) is the threshold (in number of cells) for 
the itJj connection when the used portion of the buffer is U. T^i 
is the minimum required buffer threshold allocation (in number 
of cells) for the i^^ connecrion buffer when the buffer is full 
and Yi is preferably a power of two chosen for the i^^ connection 
at the time the connection is set-up. Both Tpi and Yi are chosen 
based on the service category of the connection. 

In addition, the buffer management scheme of the present 
invention sets minimum and maximum buffer sizes based on the 
service category of the connection. Preferably, a minimum 
buffer is guaranteed for service categories above UBR 
(unspecified bit rate) . For UBR traffic, the minimum buffer 
available is determined by the number of backlogged connections. 
The maximum buffer size for each connection is a function of the 
total buffer size B, T^i, and Yi- 

Additional objects and advantages of the invention will 
become apparent to those skilled in the art upon reference to 
the detailed description taken in conjunction with the provided 
figures . 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a graph of the relationship between dynamic 
threshold and overall buffer occupancy; and 

Figure 2 is a flow chart illustrating the operations of an 
apparatus according to the invention* 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

As mentioned above, a dynamic threshold T(U) can be set 
such that if the number of cells Qvc ^ buffer equals or 
exceeds the threshold {Qv(^T(U))r cells arriving at the buffer 
are discarded. Referring now to Figure 1, the dynamic threshold 
T(U) is shown to be a linear function of the overall buffer 
occupancy U. In particular, it will be noted that as the 
overall buffer occupancy increases, the dynamic threshold 
decreases, i.e. cells will be discarded sooner. Thus, the 
linear function has a negative slope. The "y intercept" of the 
function, labelled "x" on the y-axis of Figure 1, is the integer 
value of the dynamic threshold when the overall buffer occupancy 
is empty. Thus, the minimum required buffer threshold 
allocation Tq should be some integer number less than or equal to 
X. According to standard practices, buffer thresholds are set 
by add/subtract shift operations. Therefore, the slope of the 
function is preferably limited to an integer power of two, i.e. 
2y. The intercept and the slope of the function T(U} can be 
chosen so that the threshold has some value Tp when the buffer is 
full as shown in equation (3) . 

T(B) = T^^ X - 2^B (3) 

Thus, the value of the intercept x can be expressed as shown in 
equation (4) . 



F 



(4) 
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As mentioned above, the threshold when the buffer is empty 
should be less than or equal to x as shown in equation (5) . 

^ ^ ^0 (5) 

Substituting equation (4) for x in equation (5) yields equation 
(6) . 

+ ^ r (6) 

Equation (6) can be rewritten as equauion (7) . 

B 

Therefore, an appropriate algorithm for choosing the value of y 
in order to set the slope of the threshold function can be 
expressed as equation (8) • 

y=H(^]] (8) 

According to one embodiment of the invention, equations (4) 
and (8) may be used directly at the time a VC is set up to 
determine x and y from B, To, and T^, However, in the preferred 
embodiment y is selected on a per class basis, i.e. the value of 
y depends solely on the service category and the size of the 
buffer. rp is also preferably based solely on the service 
category . 

With the above considerations in mind, the buffer threshold 
formula according to the invention can be expressed in 
simplified form as equation (9) . 

TiU) = T^^ rJB-U) (9) 



As shown in equation (9), Ti(U) is the threshold for the i^^ 
connection buffer when the overall buffer usage is U. B is the 
total shared buffer size, and 7i is 2y where y is chosen for the 
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itA connection at the time the connection is set-up based on 
service category and total shared buffer size. The thresholds, 
buffer size and buffer usage are given as an integer nuinber of 
cells ♦ 

According to a preferred embodiment of the invention, 
minimxim and maximum queue occupancy levels (Qmi^ and Qn^x) are 
also set by the dynamic thresholding scheme for each connection 
Table 1 illustrates the presently preferred recommended dynamic 
threshold parameters for five different service categories. 
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Service 
Category 


y 


Tf 


QrtBx 




CBR 








PGR 


VBR-rt 






PCR 


VBR-nrt 


-4 


be 






ABR 


-4 


TBE 




TBS 


UBR 


0 


0 


2 


8 1 
«+M 1 



Table 1 



In Table 1, a is a dimensionless coefficient as defined by 
ITU I,371, the complete disclosure of which is hereby 
incorporated herein by reference. The default value of a is 
120 • PCR refers to the peak cell rate and XpcR refers to the cell 
delay variation tolerance or CDVT as defined in ITU 1-371 for 
constant bit rate (CBR) and variable bit rate-real time (VBR-rt) 
service categories. As above, B is the size of the shared 
buffer in number of cells, be is the effective buffer size as 
defined in IEEE Journal on Selecced Areas in Communications, 
Vol. 13, No. 6, pp. 1115-11127 (1995) and TBE is the transient 
buffer exposure as defined in ATM forum Traffic Management 
Specification 4.0, April 1996, #af-tm-0056. 000 . The minimum 
buffer size Qroin is the miniinuin size of the buffer in number of 
cells when the shared buffer is completely full. Qmax is the 
maximum queue occupancy (in number of cells) allowed for a 
particular connection. For unspecified bit rate (UBR) service, 
Qmax is purely a function of the total shared buffer size and Qmin 
is a function of total shared buffer size and number of 
backlogged connections N. For a given service category, the 
value of the y parameter should be chosen such that the 
resulting value of Qjnax is greater than or equal to the maximum 
value of Qrcan for the service category. Moreover, for a given 
service category, y should be set proportionally to the expected 
queue length of a conneccion in the category. 
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Several properties of tihe buffer management scheme can be 
ascertained from an analysis of the threshold formula shown in 
equation (9) * For example, if there are N connections each 
having a queue threshold defined by Tpi and y^r and if all 
connections are completely backlogged {i.e. their corresponding 
queue lengths are at their corresponding dynamic thresholds T± (i 
= 1, 2, 3,..., N}), then the steady-srate vc threshold (or the 
queue length) for each connection i can be expressed as shown in 
equation (10) . 



(10) 



T = Q 




The truth of equation (10) can be proven by iterative 
computation for For example, where N=2, there will be two 

iterations of equation (9), one for i=l and one for i=2. If the 
second equation is rewritten as a function of U as shown in 
equation (11) , it can be substituted into the first equation to 
establish the relationship between the two thresholds as shown 
in equation (12) . 



(11) 



{T -T ) 
^ +5 



1 F r, F r, 

(12) 



Under a complete backlog condition U=Ti-f-T2 which can be used 
to rewrite the second iteration of equation (9), i.e. where i=2, 
as equation (13) • 



(13) 



2 h hi '2 2 
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Substituting equation (12) in equation (13) yields equation 
(14) which is exemplary of equation (10) . 

(14) 2 ('*r,*n) 



Similarly, if the expression for T2 from equation (14) is 
substituted in equation (12), equation (15) is produced which is 
also exemplary of equation (10) • 

<i5) • (i+r+y,) 

Repeating this process iteratively for higher values of N, will 
establish the truth of equation (10) . 

A first corollary to the proof of equation (10) is that if 
there are N backlogged connections, each with the same Y± but 
with different Tpi, then their steady-state queue lengths will be 
given by equation (16) ♦ 



T (l^(N-l)r)^Y 
(16) 7=2 



A second corollary to the proof of equation (10) is that if 
there are N backlogged connections with the same 7i and with the 
same T^±, then their steady-state queue lengths will be given by 
equation (17) . 

(17) ' fi+iVyj 



The analytical results of equations (10), (16), and (17) 
were compared with simulation results obtained by simulating 
three connections sharing a common memory pool. The simulation 
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memory was partitioned into per connection logical queues. 
Complete backlogged conditions were created by having per 
connection input rates exceed the output rates . A comparison of 
the simulation results with the analytical results is 
illustrated in Table 2* 



r 

Number of 
Connections 


Connection Parametos 
(B=1,000 ceUs) 


Queue Lengths via 
Analytical Results 


Queue 
Simula 


Lengths 
itions 


via 1 


Yi.Tfi 




Y3»Tf3 


Qi 
cells 


02 

cells 


Qj 
cdls 


Qi 
cells 


02 

cells 


^ 1 
cells 1 




1,10 






505 






504 






2 


1,10 


2.15 




253.7 


502.5 




254 


502 




3 


1.10 


2.15 


4.20 


129.3 


253.7 


497.5 


128 


254 


498 1 


3 


1.10 


1,20 


1,30 


245 


255 


265 


244 


256 


264 1 



' Table 2 



As can be seen in Table 2, the analytical results and the 
simulation results are virtually identical. The small 
differences between the results are because the simulation 
results were truncated to the nearest integer. 

Those skilled in the art will appreciate that the dynamic 
buffer management scheme may be implemented in a combination of 
hardware and software in order to perform the functions outlined 
above. Referring now to Figure 2, an apparatus according to the 
invention will determine at 10 when a new virtual connection is 
about to be established. If a new VC is being established, the 
apparatus will determine at 12 the service category of the new 
VC and will set the parameters based on the service category at 
14, These parameters include Tj, y, Qmax/ ^nd Qnan- At 16, the 
apparatus will determine the amount of free space in the shared 
buffer and at 18 the apparatus will set the dynamic queue 
threshold using equation (9) . The apparatus will return to step 
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10. When no new VC is being established the apparatus will 
continue to monitor the amount of free space in the shared 
buffer at 16 and will reset the dynamic queue thresholds at 18 
accordingly • Based on the queue thresholds, determination may 
be made by the apparatus to discard cells which would cause the 
queue length to exceed the queue threshold. 

There have been described and illustrated herein several 
embodiments of a dynamic buffer management scheme for ATM 
switched. While particular embodiments of the invention have 
been described, it is not intended that the invention be limited 
thereto, as it is intended that the invention be as broad in 
scope as the art will allow and that the specification be read 
likewise. It will therefore be appreciated by those skilled in 
the art that yet other modifications could be made to the 
provided invention without deviating from its spirit and scope 
as so claimed. 
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Claims : 

1. A dynamic buffer management method for managing multiple ATM 
queues in a shared buffer, comprising: 

a) creating a queue for each virtual connection at the time 
the virtual connection is set up; 

b) setting a minimiim queue threshold for each queue at the 
time it is created based on the service category of the virtual 
connection for which the queue was created; 

c) dynamically adjusting the queue threshold for each queue 
based on the minimxim queue threshold and the amount of unused 
shared buffer space* 

2. A method according to claim 1, wherein: 

said step of adjusting includes increasing the minimum 
queue threshold by a fractional amount of the unused shared 
buffer space. 

3. A method according to claim 2, wherein: 

the fractional amount which is added to the minimum queue 
threshold is determined by the service category of the virtual 
connection for which the queue was created. 

4. A method according to claim 1, further comprising: 

d) setting a maximum permitted queue occupancy for each queue 
at the time it is created based on the service category of the 
virtual connection for which the queue was created, 

5. A method according to claim 4, wherein: 

the maximum permitted queue occupancy is a fractional 
amount of the dynamically adjusted queue threshold when the 
buffer is empty. 
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6. A method according to claim 4, further comprising: 

e) setting a minimum queue occupancy for each queue at the 
time it is created based on the service category of the virtual 
connection for which the queue was created. 

7. A method according to claim 6, wherein: 

the minimum queue occupancy is based on the number of 
active backlogged connections* 

8. A dynamic buffer management method for managing multiple ATM 
queues in a shared buffer, comprising: 

a) creating a queue for each virtual connection at the time 
the virtual connection is set up; 

b) setting a minimum queue threshold Tpi for each ith queue at 
the time it is created based on the service category of the 
virtual connection for which the queue was created; 

c) dynamically adjusting the queue threshold for each queue 
based on the formula 

T^(U) ^T^ Y. ' (B-U) 
where B is the total size of the shared buffer, U is the size of 
the currently used portion of the buffer, Yi is a fraction based 
on the service category of the vircual connection for which the 
queue was created, and (U) is the dynamically adjusted 
threshold (in number of cells) for rhe i^^ connection when the 
used portion of the buffer is U. 

9. A method according to claim 8, wherein: 

Yi = 2y where y is chosen based on the service category of 
the connection, 

10. A method according to claim 9, further comprising: 

d) setting a maximum permitted queue occupancy Qmax for each 
queue at the time it is created based on the formula 

T 

Q = 

fi + 2') 
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11. A method according to claim 10/ wherein: 

for CBR service and for VBR-rt seirvice y " f^^^i*^] and 



r = T • PCR . 

F PCR 



for VBR-nrt service y=-4 and Tp^jbe* 
for ABR service y=-4 and Tp=TBE; and 
for UBR service y=0 and 2y=0. 



12. An apparatus for dynamically managing multiple ATM queues 
in a shared buffer, comprising: 

a) means for creating a queue for each virtual connection at 
the time the virtual connection is set up; 

b) means of setting a minimum queue threshold for each queue 
at the time it is created based on the service category of the 
virtual connection for which the queue was created; 

c) means for dynamically adjusting the queue threshold for 
each queue based on the minimum queue threshold and the amount 
of unused shared buffer space. 

13. An apparatus according to claim 12, wherein: 

said means for dynamically adjusting includes means for 
increasing the minimum queue threshold by a fractional amount of 
the unused shared buffer space. 



14, An apparatus according to claim 13, wherein: 

said means for dynamically adjusting includes means for 
determining the fractional amount which is added to the minimum 
queue threshold based upon the service category of the virtual 
connection for which the queue was created. 

15. An apparatus according to claim 12, further comprising: 

d) means for setting a maximum permitted queue occupancy for 
each queue at the time it is created based on the service 
category of the virtual connection for which the queue was 
created . 
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16. An apparatus according to claim 15, further comprising: 

e) means for setting a minimum queue occupancy for each queue 
at the time it is created based on the searv^ice category of the 
virtual connection for which the queue was created. 
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to above. 

I acknowledge the duty to disclose information which is material to the examination of 
this application in accordance with Title 37, Code of Federal Regulations, Section 
1.56(a). 



I hereby claim foreign priority benefits under Title 35, United States Code, Section 119 
of any foreign application(s) for patent or inventor's certificate listed below and have 
also identified below any foreign application for patent or Inventor's certificate having a 
filing date before that of the application on which priority is claimed: 

Serial No. Country Filing Date Prioity Claimed? 

(D/M/YR) 

1. PCT/US99/16477 PCT/US 22/07/99 [X] YES [ ] NO 

2. [ ] YES [ ] NO 

I hereby claim the benefit under Title 35, United States Code, Section 120 of any 
United States application(s) listed below and, insofar as the subject matter of each of 
the claims of this application is not disclosed In the prior United States application in 
the manner provided by the first paragraph of Title 35, United States Code, Section 
112, I acknowledge the duty to disclose material information as defined in Title 37, 
Code of Federal Regulations, Section 1.56(a) which occurred between the filing date of 
the prior application and the national or PCT international filing date of this 
application: 
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Application Ser. No. 



Filing Date 



Status 

(patented, pending, abandoned) 



1. 

2. 
3. 




As a named inventor, I hereby appoint the following attorney(s) and/or agent(s) to 
prosecute this application and transact all business in the Patent and Trademark 
Office connected therewith: 

David P. Gordon (29.996) 
David 5. Jacobson ( 39,235) 
Thomas A. Gallaghe r (31,358) 

Address all telephone calls to: David P, Gordon at (203) 329-1160 
Address all correspondence to: David P. Gordon, Esq. 

^65 Woods En J^oad 

Stamford, Connecticut 06905 

U.S.A. 

I hereby declare that all statements made herein of my own knowledge are true and 
that all statements made on information and belief are believed to be true; and 
further that these statements were made with the knowledge that willful false 
statements and the like so made are punishable by fine or imprisonment, or both, 
under Section 1001 of Title 18 of the United States Code and that such willful false 
statements may jeopardize the validity of the application or any patent issued 
thereon, 

SOLE OR FIRST INVENTOR 

g^ignature: M^^/^h^ /^^^ Date ^^J^^f 

^ Full Name: Ift ekhar Hussain . ar^r-i J^- 

iP ^6Tz South PmK Lf^N^, SanMS.^ ^ 

Residence: 3770 Flor a Vista Avenu o , Apartment 1803 r, Santa Clara, CA 95051 

Citizenship: Pakistan 

P.O. Address: Same as address 

SECOND INVENTOR 

Signature: ^^^te _ 

Full Name: Thomas Worster 
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Residence: 199 W. Newton Street, Apartment 2, Bolton, MA 02116 
Citizenship: GB 

P.O. Address: Same as address 
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Attorney Docket No.: GDC-128 
DECLARATION FOR PATENT APPLICATION AND POWER OF ATTORNEY 

As below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my 
name, and 

I believe I am the original, first and sole inventor (if only one name is listed below) or 
an original, first and joint Inventor (if plural names are listed below) of the subject 
matter which is claimed for and for which a patent is sought on the invention entitled 

DYNAMIC BUFFER MANAGEMENT SCHEME FOR ATM SWITCHES, 

the specification of which 

[ ] is attached hereto. 

[X] was filed on: January 19, 2001 

as application Serial Number: 09/744,324 

and was amended on (if applicable): 

I hereby state that I have reviewed and understand the contents of the above 
identified specification, including the claims, as amended by any amendment referred 
to above, 

I acknowledge the duty to disclose information which is material to the examination of 
this application in accordance with Title 37, Code of Federal Regulations, Section 
1.56(a). 



I hereby claim foreign priority benefits under Title 35, United States Code, Section 119 
of any foreign applicatlon(s) for patent or Inventor's certificate listed below and have 
also identified below any foreign application for patent or inventor's certificate having a 
filing date before that of the application on which priority is claimed: 

Serial No. Country Filing Date Prioity Claimed? 
(D/M/YR) 

1. PCT/US99/16477 PCT/US 22/07/99 [X] YES [ ] NO 

2. [ ] YES [ ] NO 

I hereby claim the benefit under Title 35, United States Code, Section 120 of any 
United States app!ication(s) listed below and, insofar as the subject matter of each of 
the claims of this application is not disclosed in the prior United States application in 
the manner provided by the first paragraph of Title 35, United States Code, Section 
112, I acknowledge the duty to disclose material information as defined in Title 37, 
Code of Federal Regulations, Section 1.56(a) which occurred between the filing date of 
the prior application and the national or PCT international filing date of this 
application: 
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Application Ser. No- 



Filing Date 



Status 

(patented, pending, abandoned) 



1. 
2. 
3. 



As a named inventor, I hereby appoint the following attorney(s) and/or agent(s) to 
prosecute this application and transact all business in the Patent and Tradennark 
Office connected therewith: 

David P. Gordon (29,996) 
David S. Jacobson (39,235) 
Thomas A. Gallagher (31,358) 



Address all telephone calls to: David P. Gordon at (203) 329-1150 
Address all correspondence to: David P. Gordon, Esq. 

65 Woods End Road 

Stamford, Connecticut 06905 

U.S.A. 

I hereby declare that all statements made herein of my own knowledge are true and 
that all statements made on information and belief are believed to be true; and 
further that these statements were made with the knowledge that willful false 
statements and the like so made are punishable by fine or imprisonment, or both, 
under Section 1001 of Title 18 of the United States Code and that such willful false 
statements may jeopardize the validity of the application or any patent issued 
thereon. 

SOLE OR FIRST INVENTOR 

Signature: Date 

Full Name: Iftekhar Hussain 

Residence: 3770 Flora Vista Avenue, Apartment 1801, Santa Clara, CA 95051 
Citizenship: Pakistan 
P.O. Address: Same as address 
SECOND INVENTOR 





Signature: / ^ — ^ ^v^.^^- — Date ^/^^/^' 



Full Name: Thomas Worster 

Residence: 199 W. Newton Street, Apartment 2, Bolton, MA 02116 
Citizenship: GB 

P.O. Address: Same as address 
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